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Abstract 

We give an extension of Hoeffding's inequality to the case of supermartin- 
gales with differences bounded from above. Our inequality strengthens or 
extends the inequalities of Freedman, Bernstein, Prohorov, Bennett and Na- 
gaev. 
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1. Introduction 

Let ^1, ...,^n be a sequence of centered (E^j = 0) random variables such 
that af = E^f < oo and let X„ = V"^^ Since the seminal papers of Cramer 
(1938, [13]) and Bernstein (1946,^), the estimation of the tail probabilities 
P {Xn > x) for positive x has attracted much attention. We would like to 
mention here the celebrated Bennett inequality (1962, cf. (8b) of j2|, see 



also Hoeffding [18|) which states that, for independent and centered random 



variables C,i satisfying < 1 and for any t > 0, 



^2 \ n{t+a^) 



nXn>nt) < [-—,] e"* (1) 



exp < —nt 



(2) 
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where cr^ = ^ SiLi ^1- Further, inequahties for the probabihties P (X^ > x) 
have been obtained by Prohorov (1959, 23]), Hoeffding (1963, jisl] '). Azuma 
(1967, El], Steiger (1967, |29|p.969, jiSj), Freedman (1975, Q), Nagaev 
0979, Q), Haeusler (1984, O), McDiarmid (1989, H), Pinehs (1994, 
0), Talagrand (1995, [3l|), De La Pefia (1999, [ll|), Lesigne and Volny 
(2001, (ial), Nagaev (2003, S), Bentkus (2004, [J), Pinehs (2006, H) 
and Bercu and Touati (2008, [a]) among others. 

Most of these results were obtained by an approach based on the use 
of the exponential Markov's inequality. The challenge for this method is 
to find a sharp upper bound of the moment generating function 0j (A) = 
E(e'^^*). Hoeffding jisj, Azuma [l[ and McDiarmid 21] used the elementary 
estimation 0j (A) < e'^^/^, A > 0, which holds if < 1. Better results can be 



obtained by the following improvement (A) < 
holds for < 1 (see for example Freedman |14| l 



3-^-1- A)(t/, a > 0, which 
Bennett [^] and Hoeffding 



18| used a more precise estimation 



(A) < ^exp {-\aj] + -^exp{A}, A > 



(3) 



for any satisfying < 1. Bennett's estimation 03]) is sharp with the equality 
attained when P(^i = 1) = ^ and P(^i = -af^ - 



Using (|3]), Hoeffding improved Bennett's inequality ([T]) and obtained 
the following inequality: for independent and centered random variables 
(6)i=i,...,n satisfying < 1 and for any < t < 1, 



P(X„>nt) < { (1 + ^) ^ {1-ty 



a' 



(4) 



where cr^ = i ^Li ^.'(cf- (2.8) of [is!). 

It turns out that, under the stated conditions, Hoeffding's inequality 
(j4l) is very tight and improving (jlj) is a rather difficult task. Significant 
advances in improving Hoeffding's and Bennett's inequalities have been ob- 
tained by several authors. For instance Eaton 13|, Pinelis |25i] and Talagrand 
3l| have added to (jl]) a missing factor of the order Improvements of 



the Bennett's inequality ([T]) can be found in Pinelis 26|, where some larger 
classes of functions are considered instead of the class of exponential func- 
tions usually used in Markov's inequality. When are martingale differences. 
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Bentkus showed that if the conditional variances of are bounded, then 
IP(-^n > a;) < c IP(X]r=i — "where rji are independent and identically 
distributed Rademacher random variables, c = = 3.694... and a; is a 
real such that P(X]r=i ^« — ^) '^^^ ^ jump at x (see also jsj for related re- 
sults). However, to the best of our knowledge, there is no martingale or 
supermartingale version which reduces exactly to the Hoeffding inequality 
dl]) in the independent case. 

The scope of the paper is to extend the Hoeffding inequality @ to the 
case of martingales and supermartingales. Our inequality will recover (jl]) in 
the independent case, and in the case of (super)martingales will apply under 
a very weak constraint on the sum of conditional variances. 

The main results of the paper are the following inequalities (see Theorem 
12.11 and Remark 12. ip . Assume that (^i, J^i)j=i,...,n are supermartingale differ- 
ences satisfying < 1. Denote by {X)k = Yli=i^i^i\-^i~i-) ^ — 
Then, for any x > and v > 0, 

P (Xfc > X and {X)k < v'^ for some k G [1, n]) 

„2 



2 \ X+V^ / \ n — X 1 n + v'^ 



S •^-v[-i^gr^^]. (6) 

In the independent case, inequality (E]) with x = nt and f ^ = na"^ reduces 
to inequality (jl]). We will see that the inequalities and (E]) strengthen 
or extend many well-known inequalities obtained by Freedman, De La Pefia, 
Bernstein, Prohorov, Bennett, Hoeffding, Azuma, Nagaev and Haeusler. In 
particular, if the martingale differences (^i, ^j)j=i,...,n satisfy — & < < 1 for 
some constant b > 0, then we get (see Corollary 12. ip . for all x > 0, 

P ( max Xk >x^ < exp |- 1 , (7) 



l<fc<n J [ Un{x,b) J 

where 

Un{x, b) = min <|n(l + 6)^, 4 + -x 
Notice that inequality ([7]) is sharper than the usual Azuma-Hoeffding in- 



equality when 0<x<|n(l — 6)^ 
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Our approach is based on the conjugate distribution technique due to 
Cramer, and is different from the method used in Hoeffding's original paper 



18|. The technique has been developed in Grama and Haeusler jl6| to obtain 
expansions of large deviation for martingales. We refine this technique to get 
precise upper bounds for tail probabilities, providing a simple and unified 
approach for improving several well-known inequalities. We also make clear 
some relations among these inequalities. 

Our main results will be presented in Section |2] and proved in Sections [3] 
andm 



2. Main Results 

Assume that we are given a sequence of real supermartingale differences 
i^i, J^i)i=o,...,n, defined on some probability space {Q,J',¥), where = and 
{0, f2} = J^o ■■■ J^n are increasing a-fields. So, by definition, we 
have E(^j|J^j_i) < 0, z = l,...,n. Set 

k 

Xo = 0, Xk = J2^i, k = l,...,n. (8) 

1=1 

Let {X) be the quadratic characteristic of the supermartingale X = (X^, J^^): 

k 

(X)o = 0, {X), = J2m■\J'^-l), A; = l,...,n. (9) 

1=1 

Theorem 2.1. Assume that (^j, v^j)i=i,...,n ore supermartingale differences 
satisfying < 1. Then, for any x > and v > 0, 

F{Xk>x and {X)k < for some k G [1, n]) < Hn{x, v), (10) 

where 



Hn{x,v) = 




with the convention that (+oo)° = 1 (which applies when x = n). 
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Because of the obvious inequalities 

P (X„ > X, (X), < (11) 



< P max Xk > X, {X)n < (12) 

yl<fc<?i J 

< P {Xk > X and {X)k < f ^ for some k G [1, n]) , 

the function Hn{x,v) is also an upper bound of the tail probabilities flTTl) 
and ([T^ . Therefore Theorem 12.11 extends Hoeff ding's inequality (jl]) to the 
case of supermartingales with differences satisfying < 1. 

The following remark establishes some relations among the well-known 
bounds of Hoeff ding, Freedman, Bennett, Bernstein and De La Pena. 

Remark 2.1. For any x > and v > 0, it holds 



V 



2 \ x+v^ 



Hn{x,v) < F{x,v)=: {^^] (13) 

X + 



< Bi{x,v) =: exp < , ^ > (14) 



y2 



x"^ 



< B,(..„)=:exp|-5^-^|. (15) 

Moreover, for any x,v > 0, Hn{x,v) is increasing in n and 

lim Hn{x,v) = F{x,v). (16) 

n—^oo 

Since Hn{x,v) < F{x,v), our inequality ( [T0|) implies Freedman's inequal- 
ity for supermartingales The bounds Bi{x,v) and B2{x,v) are respec- 
tively the bounds of Bennett and Bernstein (cf. [2], (8a) and [3]). Note 
that Bennett and Bernstein obtained their bounds for independent random 
variables under the Bernstein condition 

E|e.|'<^0 Ml for k>3. (17) 

We would like to point out that our condition < 1 does not imply Bernstein 
condition ( IT71) . The bounds Bi{x, v) and B2{x, v) have also been obtained by 
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De La Pena ([iJ], (1-2)) for martingale differences satisfying the conditional 
version of Bernstein's condition ( 1T7|1 . Our result shows that the inequalities of 
Bennett ([2), (8a)), Bernstein and De La Pena ([llj, (1-2)) also hold when 
the (conditional) Bernstein condition is replaced by the condition < 1. So 
Theorem 12.11 refines and completes the inequalities of Bennett, Bernstein and 
De La Pena for supermartingales with differences bounded from above. 
It is interesting to note that from Theorem 12.11 and (HM it follows that 



F (^fc > I + vV2^ and {X)k < for some k G [1, n]) < e""^, (18) 

which is another form of Bennett's inequalities (for related bounds we refer 
to Rio j28j and Bousquet jsj). 

If the (super)martingale differences {^i, J-'i)i=i,..,n are in addition bounded 
from below, our inequality (fTOj) also implies the inequalities (2.1) and (2.6) 
of Hoeffding [lij as seen from the following corollary. 



Corollary 2.1. Assume that J^i)i=i,...,n (ii"^ martingale differences satis- 
fying — 6 < < 1 for some constant b > 0. Then, for any x > 0, 

P max Xk>x^ < Hn (^x, Vnb^ (19) 
( max Xk> x^ < exp 1 , (20) 

\l<k<n ^- J - ^\ f/„(x,6)J' ^ ^ 



and 



where 



P 



Un{x, b) = min ^n{l + 6)^, 4 ^b + -x 

The inequalities ( f7P|) and remain true for supermartingale differences 
J^i)i=i,...,n satisfying —b<C,i<l for some constant <b <1. 

In the martingale case, our inequality (fT9|) is a refined version of the in- 
equality (2.1) of Hoeffding [isj in the sense that X„ is replaced by maxi<fc<„ Xk. 
When Unix,b) = n{l + bf, inequality (EO]) is a refined version of the usual 
Azuma-Hoeffding inequality (cf. [l8|, (2.6)); when < a; < |n(l — 6)^, 
our inequality fl20|) is sharper than the Azuma-Hoeffding inequality. Related 



results can be found in Steiger [29|, [30[, McDiarmid [21[, Pinelis [26| and 
Bentkus 8, 0. 



The following result extends an inequality of De La Pena ([ll|, (1.15)) 
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Corollary 2.2. Assume that {Ci, J^i)i=i,...,n ore supermartingale differences 
satisfying < 1. Then, for any x > and f > 0, 



P {Xk > X and {X)k < f ^ for some k E [1, ra]) 

X ..fx 
-arcsmh 



< exp <! — — arcsinh ( j i . (21) 



De La Pefia [HI] obtained the same inequality ( 1211) for martingale dif- 
ferences {^i, J^i)i=i^...^n under the more restrictive condition that < c for 
some constant < c < oo. In the independent case, the bound in ( I2T1) is the 
Prohorov bound As was remarked by Hoeffding 18], the right side of 
(ITU]) is less than the right side of (^11) . So inequality (ITUI) implies inequality 

(EH). 

For unbounded supermartingale differences (^j, J-i)i=i,...,n, we have the 
following inequality. 

Corollary 2.3. Assume that (^j, J^i)i=i,...,n o'^e supermartingale differences. 
Let y > and 

k 

V^{y) = Y,m'M^.<y}\^:-i). k = l,...,n. (22) 

i=l 

Then, for any x > 0, y > anc? f > 0, 

P (-^fc > a; and V^{y) < for some k G ]1, "".]) 
< Hr,(-,-]+F(max^,>y]. (23) 



y y 



l<i<n 



We notice that inequality (l23l) improves an inequality of Fuk ([l5|], (3)). 
It also extends and improves Nagaev's inequality (j22[, (1.55)) which was 
obtained in the independent case. 

Since ¥{V^{y) > v^) < P((X)„ > v^) and H^ix,v) < F{x,v), Corollary 
implies the following inequality due to Courbot jof: 



P max Xk>x\ < F 

l<k<n 



f-,-) +X;P(e.>l/)+P((X)„>t;2). (24) 

\y yJ ^ 



A slightly weaker inequality was obtained earlier by Haeusler 17| : in Haeusler's 
inequality F ^ j is replaced by a larger bound exp 1 1 (l — log ^) | . Thus, 
inequality f l2^ improves Courbot's and Haeusler's inequalities. 
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To close this section, we present an extension of the inequahties of Freed- 
man and Bennett under the condition that 

E(e,V«>|J'i-i) <e^E(ef|J-i-i), for any A >0, (25) 

which is weaker than the assumption < 1 used before. 

Theorem 2.2. Assume that {C,i, J^i)i=i,...,n ore martingale differences satis- 
fying l[25\) . Then, for any x > and v > 0, 

P {Xk > X and {X)k < v"^ for some k G [l,n]) < F{x,v). (26) 

Bennett ^ proved fl2^ in the independent case under the condition that 

El^l'' < E^f , for any A; > 3, 

which is in fact equivalent to < 1. Taking into account Remark 12. ![ we 
see that fl2Bl) recovers the inequalities of Freedman and Bennett under the 
less restrictive condition (^^. 

3. Proof of Theorems 

Let {^i, J^i)i=o,...,n be the supermartingale differences introduced in the 
previous section and X = {Xk, J^k)k=o,...,n be the corresponding supermartin- 
gale defined by (|8]). For any nonnegative number A, define the exponential 
multiplicative martingale Z{X) = {Zk{X) , J^k)k=o,...,ni where 

If T is a stopping time, then Ztaa:(A) is also a martingale, where 

i=l ^ ' ' 

Thus, for each nonnegative number A and each k = l,...,n, the random 
variable Zt'aA:(A) is a probability density on (fi, J-", P), i.e. 

/ ZxAk 

(A)dP = E{ZTAk{X)) = 1. 
8 



The last observation allows us to introduce, for any nonnegative number A, 
the conjugate probability measure Fx on {Q, J-") defined by 

dFx = ^TA„(A)f/P. (27) 

Throughout the paper, we denote by the expectation with respect to P^. 

Consider the predictable process \I/(A) = {"^kW, J^k)k=o,...,n, which is 
called the cumulant process and which is related to the supermartingale X 
as follows: 

k 

*fc(A) = J]logE(e^«»|j;_i), 0<k<n. (28) 

i=l 

We should give a sharp bound for the function ^'^(A). To this end, we need 
the following elementary lemma which, in the special case of centered random 
variables, has been proved by Bennett 0]. 

Lemma 3.1. If is a random variable such that ^ < 1, < and E^^ = 
cr^, then, for any A > 0, 

E(e^«) < T^exp {-Xa'} + -^exp{A}. (29) 



Proof. We argue as in Bennett j2|. For A = 0, inequality ( 129|) is obvious. 
Fix A > and consider the function 

m = ae + b^ + c, e<i, 

where a, b and c are determined by the conditions 

0(1) = e\ (j){-a^) = \(j)'{-a^) = exp{~Xa^}, A > 0. 

A 

By simple calculations, we have 

_ - e-^"' - A(l + (T2)e-^"' 

" (T + ^T ' 

A(l - a4)e-^'^' + 2a2(e^ - e-^'^') 



and 



(1 + (t2)2 

a^e^ + (1 + 2a^ + Xa^ + Xa^)e-^''' 
(l + cr2)2 
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We now prove that 



< 0(0 for any ^ < 1 and A > 0, (30) 
which will imply the assertion of the lemma. For any ^ G M, set 

/(o = m - e'«. 

Since /(— a^) = /(I) = 0, by RoUe's theorem, there exists some G (— cr^, 1) 
such that /'(^i) = 0. In the same way, since /'(— cr^) = and /'(^i) = 0, 
there exists some ^2 G (— (T^,^i) such that /"(^2) = 0. Taking into account 
that the function /"(O = 2a — A^e'*'^ is strictly decreasing, we conclude 
that ^2 is the unique zero point of f"{^)- It follows that f{C,) is convex 
on (—00,^2] and concave on [^2,1], with min(_oo,g2] /(O = fi~^'^) = 
min[g2,i] /(O = /(I) = 0- Therefore min(_oo,i] /(O = 0; which implies fl5U]) . 
Since 6 > and EC, < 0, from fl5U]) . it follows that, for any A > 0, 

E(e^«) <aa^ + c= -^exp {-AaH + exp{A}. 

1 + cr^ 1 + (T^ 

This completes the proof of Lemma I3.1[ □ 



The following technical lemma is from Hoeffding [18|] (see Lemma 3 therein 



and its proof). For reader's convenience, we shall give a proof following 18 



Lemma 3.2. For any A > and t >0, let 

/(A, t) = log exp {-At} + ^ exp{A} ) . (31) 

Then ^J'{X,t) > and ft/(A,t) < for any X > and t > 0. 
Proof. Denote 

9{y) = , z/>i- 

y 

Then /(A, t) = X + log (7(1 + t). By straightforward calculation, we have, for 
any y > I, 

e-^y(e'y - 1 - Xy) ^ ^ 

9 (y) = -2 > 

10 



and 

g"{y) = -^{e''-i-\y-^)<Q. 

Since g{y) > for ?/ > 1, 

^ f(X t) - ''^y^ and f(X t) - 3"iy)9iy)-9'iy? 

it follows that |/(A, t) > and ft/(A, t) < for all A, t > 0. □ 

Lemma 3.3. Assume that (^j, J^i)i=i^...^n o^^e supermartingale differences sat- 
isfying < I. Then, for any A > and k = 1, ...,n, 

^k{\)<kf(^X,^y (32) 

Proof. For A = 0, inequality (13 2 p is obvious. By Lemma \'d.l\ we have, 
for any A > 0, 

< exp{-AEK?|7; .)} m\TU, 
^ - 1 + E({?|J-,_,) l + E(g|JF-i_i) ^ 

Therefore, using ( 13T|) with t = K{^f\J^i_i), we get 

logE(e^«'|J-,_i) < /(A,E(C'|J-,_i)). (33) 

By Lemma [3.2[ for fixed A > 0, the function f{X,t) has a negative second 
derivative in t. Hence, f{X,t) is concave in t > 0, and therefore, by Jensen's 
inequality. 



(34) 



= A:X^^/(A,E(e?^|^.-i)) < kf (a,^) . 

i=l i=l ^ ^ 

Combining ( 133|) and fl34|) . we obtain 

vI/,(A) = X^logE(e^«^|J-._i) < kf (x, ^) . 
1=1 ^ ' 

This completes the proof of Lemma I3.3[ □ 
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Proof of Theorem 12.11 For any < x < n, define the stopping time 
T{x) = mm{k e [1, n] : > x and (X)^ < v"^}, (35) 
with the convention that min{0} = 0. Then 

n 

l{Xk > X and {X)k < for some A; G [l,n]} = ^ 1 {T{x) = k} . 

k=l 

Using the change of measure fl27]) . we have, for any 0<a;<r;,,f>0 and 
A > 0, 

P [Xk > X and {X)k < for some k G [1, n]) 
= ExZtauW l{Xfc>x and (x)k<v^ for some keli,n]} 

n 

= ^ Ea exp {-XXtau + ^TAn(A)} l{T{x)=k} 

k=l 
n 

= ^EAexp{-AXfc + ^fc(A)}l{T(x)=fc} 

k=l 

n 

< ^EAexp{-Ax + ^fc(A)}l{rw=fc}. (36) 

k=l 

Using Lemma [331 we deduce, for any 0<x<?t,, t>>0 and A > 0, 
P(Xfc > X and {X)k < for some k e [l,n\) 
< X^EAexp|-Aa; + fc/(^A,^^|l|T(.)=fc}. (37) 

By Lemma [3.21 f{X,t) is increasing in t > 0. Therefore 

P(Xfc > X and {X)k < for some k G [l,""-]) 

- X^EAexpj-Ax + fc/ (^A,^^|l{T(..)=fc}- (38) 

As /(A,0) = and f{X,t) is concave in t > (see Lemma [3 ■2p . the function 
f{\,t)/t is decreasing in t > for any A > 0. Hence, we have, for any 

12 



0<x<n, v>0 and A > 0, 

P(Xfc > X and {X)k < v"^ for some k G [1,-^]) 
< exp I -Ax + nf (x, } 5Z '^m^)=k} 



n 



< exp <; -Ax + n/ ( A, — ) !> . (39) 



Since the function in ( l39l) attains its minimum at 

1 1 -I- r /?;^ 

A = A(,t) = -— ^ log -i^, (40) 
1 + t>"^/r2 1 ~ x/n 

inserting A = A(x) in fl39l) . we obtain, for any < x < and f > 0, 
P (-^fc > X and < for some k G [1,""-]) < if„(x,f), 

where 

Hn(x, v) = inf exp < —Ax + nf ( X, — ) \ , (41) 
A>o V n / 



which gives the bound (iTOll . □ 
Proof of Remark 12.11 We will use the function /(A, t) defined by fl3T]) . 
Since ^/(A,t) < for any t > and A > 0, it holds 

/(A, t) < /(A, 0) + ^/(A, 0) t = (e^ - 1 - A) t, t, A > 0. (42) 

Hence, using ( BTj) . for any x > and > 0, 

HJx,v) < inf exp |-Ax + (e^ - 1 - A)^;^ 
A>o 

^ e^ (43) 



X + 

which proves f|T3|) . Using the inequality 



2„,2 



(e^ - 1 - X)v^ < ^ for any X,v>0, 
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we get, for any x > and v > 0, 



2 \ x+v f \1 1 

e < ini exp < —Ax + 



X + uV ~ 3>A>0 ^\ 2(1 -iA) 



X 



3' 
2 



exp 



< exp 



2{v^ + |x) 



where the last inequahty follows from the fact y 1 + §^ < 1 + 3^2 • This 
proves (fT^ and (fTSi) . 

Since /(A, it)/t is decreasing in t > for any A > 0, from (HTi) . we find that 
Hn{x,v) is increasing in n. Taking into account that lim„_j.oo {:;^)"^ ^ = e^, 
we obtain fll6p . This completes the proof of Remark 12.11 □ 

Lemma 3.4. Assume that (^j, J-i)i=i,...,n are martingale differences satisfy- 
ing 

my^'\J'^-l)<e^m^\J'i-l) 

for any A > 0. Then, for any A > and k = 1, ...,n, 

"ifkW < (e"-l-A)(X)fc. 

Proof. Denote ^i{X) = log E(e^«' | J^.i), A > 0. Since V'i(O) = and 
-0^(0) = E{^i\J^i_i) = 0, by Leibniz-Newton formula, it holds 

Jo Jo Jo 

Therefore for any A > and k = 1, n, 

vi>,(A) = J2m) = Y.f l%-{t)dtdy. (44) 

Since, by Jensen's inequality, E(e*^' | > 1, we get, for any t > 0, 



E(e*«>|J'i_i) E(e*«>|J'i_i)2 

< E(e^*«'|J-^-i) 

< e'ne^\^^-l)■ (45) 
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Inserting into we obtain 

= (e^-l-A)(X)fc. 

This completes the proof of Lemma 13.41 □ 

Proof of Theorem 12.21 By fl5^ and Lemma 13.4^ we obtain, for any 
X >0, V > Q and A > 0, 

P [Xk > X and {X)k < v'^ for some k G [1, n]) 

n 

< ^EAexp{-Aa; + ^fc(A)}l{T(:..)=fc} 



fc=i 



< ^EAexp{-Aa; + (e^-l-A)(X)fc}l 



{T{x)=k} 



k=l 



< ^ Ea exp {-Ax + (e^ - 1 - X)v^} l{T{x)=k} 

k=l 

< exp { - Ax + (e^ - 1 - A)t;2 } . (46) 
Since the function in fB6l) attains its minimum at 

A = A(x) = log (l + J) , (47) 

inserting A = A(x) in (H6l) . we have, for any x > and f > 0, 



P (Xfc > X and {X)k < for some /c G [1, 



n\ 



2 \ x+v"^ 

< F(x.v) = ( I 
X + f ^ 



This completes the proof of Theorem 12.21 □ 

4. Proof of Corollaries 

We use Theorem 12.11 to prove Corollaries 12.11 and 12.31 



15 



Proof of Corollary Em As -b < < 1, we have < b and 1-^^ > 0, 
so that - ^i) < 6(1 - ^i). When E(^i| J'i^i) = or E(^i| J'i^i) < and 

< 6 < 1, it follows that 

= H-u^-^i)\J'^-l)+mi\J'i-l) 

< b. (48) 
Therefore < nb. Hence, using Theorem 12 .11 we have, for any < x < n, 

P I max Xk > X \ < sup P (X^ > x and {X)^ < f ^ for some k G [1, n]) 

\l<fc<n y ^2<„b 

< sup Hn{x, v) 

v'^<nb 

= H^(^x,V^y (49) 
which obtains inequality ( fTOl) . Using ( fTSl) . we get, for any x > 0, 

l/„(.,V;^)<exp{-5^-i;l^}. (50) 

From ( HTj) . we have, for any x > 0, 

HnixyVnb] = inf exp {— Ax + n/(A, 6)} . (51) 

With the notations z = \{1 + b) and p = we obtain 

/(A, b) = g{z) = -zp + log(l -p + pe^). 
Since g{0) = g'{0) = 0, 



g [z) = -p 



p + (1 - p)e'^ 

and 



we have 



^ p{l-p)e-^ ^ 1 
^ ^ ' {p+{l-p)e--y - 4' 



/(A,6) = ^7(^)<l^' = ^A2(l + 6)^ 
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Returning to (1^ . we deduce, for any x > 0, 

Hnix,\/nb] = inf exp {— Ax + n/(A, 6)} 

< inf exp |-Ax + iA^n(l + 6)^ 

Combining and §2i), we obtain ([20]). □ 
Proof of Corollary 12.31 For y > and k = 1, n, set 

k 
i=l 

k 



X, = X', + XI and Vl{y) = m^M^.<y}\J'^ 



Since E{^^Ti-\) < implies E{^il{^^<yj\J^i^i) < 0, is a sum of super- 
martingale differences. Now, for any y > 0, < x < ny and f > 0, 

P (Xfc > X and V^{y) < f ^ for some A; G [1, 
= P (X^ + X^' > X and if (y) < for some A; e [1, n]) 

< P (Xfc > X and V^{y) < for some k e [1, n]) 
+P (Xfc > and Vfc^(t/) < v'^ for some A; G [1, n]) 

/X' T V'^dA 

< p ^ > _ and < — for some k G [1, n] 

\ y y y y 

+P(max6>y). 

Applying Theorem 12. II to X^ = we obtain Corollary 12.31 □ 
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